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Convergence in Mean 


7.2.6 Convergence in Mean 

One way of interpreting the convergence of a sequence X n to X is to say that the "distance" between X 
and X n is getting smaller and smaller. For example, if we define the distance between X n and X as 
P(\x n -x\ > e) , we have convergence in probability. One way to define the distance between X n 
and X is 


E(\X n -X\ r ), 

where V > 1 is a fixed number. This refers to convergence in mean. {Note: for convergence in mean, it is 
usually required that E\X^ | < OO.) The most common choice is r — 2, in which case it is called the 
mean-square convergence. {Note: Some authors refer to the case r — 1 as convergence in mean.) 

Convergence in Mean 

Let r > 1 be a fixed number. A sequence of random variables X\, X 2 , X 3 , • • • converges in the T'th 

L r 

mean or in the L r norm to a random variable X, shown by X n -> X, if 

lim E (\X n - X\ r ) = 0. 


m.s. 

If r — 2, it is called the mean-square convergence, and it is shown by X n - > X. 


Example 7.10 


Let X n ~ U niform (o, . Show that X n -> 0, for any r > 1 . 


Solution 

o The PDF of X n is given by 


fx n (x) 


n 0 < x < — 


0 otherwise 


We have 


E (|X„ - 0| r ) = [ 

JO 


x r n dx 

1 


(r + 1 )n r 


0, for all r > 1. 
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Theorem 7.3 

L s L r 

Let 1 < r < S. If X n -> X , then X n -> X. 

• Proof 

o We can use Holder's inequality, which was proved in Section . Holder's Inequality states that 

l l 


E\XY\ < (E\x\ p ) p (E\Y\ q ) 1 , 


where 1 < p , Q < OO and ^ = 1. In Holder's inequality, choose 


x=\x n - x\ 


Y= 1, 

s 

p = — > 1. 

r 


We obtain 


E|X„-X| r < (£|V„-V| S )!'. 


Now, by assumption X n - > X, which means 

lim E (\X n — XI s ) = 0. 

71—>■ OO V 7 

We conclude 

lim E (|X n - X| r ) < lim (£7|X n - X\ s ) 


n—>oc 


n—>oc 

= 0. 


Therefore, X n -> X. 


As we mentioned before, convergence in mean is stronger than convergence in probability. We can prove 
this using Markov's inequality. 


Theorem 7.4 

L r p 

If X n -> X for some T > 1 , then X n —> X. 

• Proof 

o For any € > 0, we have 
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P(\x„ -x\>e)= P(\x n - x\ r > £ r ) 

„ E\Xn - X\ r 


(since r > 1) 
(by Markov’s inequality). 


Since by assumption lim E (| X n — X| r ) = 0 , we conclude 

n —7 > oo v 7 

lim P(\X n — X\ > e) = 0, for all e > 0. 

n—>oc 1 / 


The converse of Theorem 7.4 is not true in general. That is, there are sequences that converge in probability 
but not in mean. Let us look at an example. 


Example 7.11 

Consider a sequence {X n , n 

X n 


Show that 


1, 2, 3, • • •} such that 


{ n 2 with probability ^ 

0 with probability 1 — ^ 


p 

a. X n 0. 

b. X n does not converge in the rth mean for any r > 1. 
• Solution 


O 


a. To show X r 


0, we can write, for any e > 0 



> e) = lim P(X n 

* n—>oc 

= lim — 

n—>oo n 

= 0. 



We conclude that X n —> 0. 
b. For any T > 1, we can write 

lim£(|X„r) 

n—^oo 


lim ( n 2r • — + 0 • ( 1 

n-S-oo V n V 


1 

n 


lim n 

n—>oo 


2r—1 


= oo (since r > 1). 
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Therefore, X n does not converge in the rth mean for any T > 1 . In particular, it is 

V 

interesting to note that, although X n —> 0, the expected value of X n does not 
converge to 0. 


<— previous 
next —»• 
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